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The potential toz Q§lng case exaiples In the > * 
edacatlon of evalaators Is paralleled to the legal case aethod of 
instfnction^ carreiitly ased in the edacatj^n of lav stadents. Bays in 
vhicb SQch cases are ased i€ Instruction are discassed* Zypes of 
information. an evalaation case history light contain are then 
docaientea, and the QOBRAC acronyi is presented a'a a nod^l o£ this. 
QaBRAC is covprised of a series of six* points that shoalil be 
Incorporated in an ev^la^^ion^ qaestions (issues) ; anqaestloned 
assuipti^jns^ (principles) ; event/object evaluated (case facts) ; 
ansvers/clalvs (d*ecisiOns) ; concepts/gonceptaal struct qc^ (legal 
principles). Leg^l case history parallels appear in parenthesis. This 
lodel also, r^equires the inclusion, of procedural history for 
evaluation p^poses^ Three essential devices of the case jiet hod of 
instruction are discussed in tens of how they lighi be^pplied to ^ 
the educatioi^ of evaluators: .(1) case^book; (2) student class 
participation: (3) problem-type ezamitifLtion iteis. In con das ion, .it 
£s suggested ^Ithat iiplei^Qtation of such an instractional method may 
{iroVe difficult since no systeir>exists vhereby evaluation case 
histories arelvrit^en up, an4 thB exposition af_the logic ^cinderXying 
an evaluation lis rarely given 3^ an evaluati:^ report. A) 
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Part I: The Use of Cases in Legal Education 



Legal education in the (Jnitod Statos (that^is to say/^the 
i . 

three-year programs at postgraduate^level law schools) has for 
many yeeurs been characterized bottr by the use of the Socratic 
method of pedagogy and by the study of reported case opinions as 
primary material.^ Neither this method of* instruction nor this 
ohQicQ of study material is strictly necessary to legal * 
education. One could^ for example/ simply lecture or develop 
programmed instruction about the history anrd d^v^eloproent of 
generalized legal principles* Since reported qase opinions are 

r 

the ttM material with which practicing attorneys must deal/ ^ 



bowe^er, at sc»ne point in the student's legal^ education it would j^' 
be ne^^tt^sary to expose him to actual case opinions and to teach 
him t6 analyz^ and apply them. In "most American law^schools^ 
nSoreover/ repo|t^ed <^a^» are used, not merely to acquaint the, 
student with tK^^ fora and application^ but as the sole source 
of learning what ^he^law is« The Socratid method of instruction/^ 



by whiclv the teacher asks the student ^ ser 



les <^f 



questions and i 



requires, the studer/t to develop his oWn understanding of tfie ^ : 
underlying principles/ complements the use of the case method. 

The law student-*^8*textboolcs are, appropriately' e^ough^ called^] 
•casebooks. These consist almost entirely of r^p^rted case ^ 
Opinions, 8c»neJtimes with question^ following each case, and with 
citation to other cases with similar (or contra^Jkctory) results. 
Some <^a8ebook8/inc^^ brief introductory and bapxground 
matjerials; a few add. commentarj^t They rarely, however, provide . 
any^structure^ presentation or straightforward statement «of the 
basic legal p/rinciples to be learned/ Rather, the student is to 
extractr an apstract'^f those principles for himself by the 
careful reading and analysis of the case opinions. * 



The casebook authoif chooses the casgs he wishes to pcesfent * 
*and organizes them m sections illustrating tfye various subject 
' natters. The casfes will typically be arranged* to sl?ow the- 
development bf a particular concept by successive courtSi or to - 
contrast different courts' approaches tp the same problem* 
Frequently a particularly important and influential case will be 
highlighted, and then followed by decasions of later -courts * ^ 
interpreting and , applying the princ^iples ewjnci^t^6^n the 
earlier case to different factual situations. The cases are 
. edited to some degree by the casebook ^uthor^ but are not so 
heavily edited that only the crucial' paragraphs of the*opinion 
are printed. Rather, it is'an important part of^ the law 
student's task to leacn to ar^alyze the case th^ro^jghly and to 
discover which questions are most pressing and which arguments 
are mo^t persuasive. ,The factual context which provides the 
jDasis for discussion oi legal principles is also Included in" 
full; as noted, it is that factual context which colors and. gives 
concrete leaning to the stated principles and provides a standard 
for their ^valuation* 

1 * Under. ^the most traditi^onal and* formal sort of legal 
education, the students are, assigned^ a group of cases to read,^ 
analyze, and prepare* During the class period, one student will, 
be called upon ^ orally .present his prepared brief of the case* 
The stfudent ^ives a summary of'*the most, important factsr a 
'synoposis of the procedural^ history of the case; a' statement of > 
the legal issues to be decided by the court; ^ recitation of the 
Courtis discussion and legal reasoning regarding those issues; 
and a statement of the court's holding and decision on thos^ 
, legal issues* Thc£ opinions pf any dissenting judges are likewise 
citftd ^nd discussed^ The student's particular statement of the 
legal issues and of the court 'sj)olding is frequently subjected 
to criticism* , (The primary^ lesson to be learned here is the 
necessity of precise s'tatergent.) ' In addition, it is likely that 
the student yill be asked questions regarding the ^jfjlfle^s 
reasoning* \ , * 



* . Once the assigned caSe has been thoroughly expoundea* dod^ 
explicated, the professor m^y peseta hypothetical fact situation 
wh'ich varies 'either m character or degree from that presented. by 

Vtbe assigned- ca^es^thenselves* \The studpnt • s* task then is to 
decide how the court would decide the hypothetical case^^ . 
supporti{rg his answer with particular language from the -reported 
case/* if possible. Often the professor will propound a series of 
questions* That question sequence is designed to elicit answers 
that illustrate the crucial factual elements of the decided case, 
as well\s the bfreadth or narrowness of its reasonirig* ' 
- « This pedagogical teclvniqu^ emphasizes^ in the roost concrete ' 
fashion, the notion that a court's decision in a givetl case is 
limited in .its coercive effect to the imediate pa^rties to the 
suit and to the particular facts' of that litigation* The court's 
reasoning/' h&wever, may be applied «to analogous^ although 
varying/ factual patterns* The student must determine whether 
the law professor's hypothetical fact situation is sufficiently 
a'nalogous to that presented in the decided case^ that the 
application of, the court's reasoning will produce \he same result 
or whether/ in contrast/ the hypothetical fa^ts are 
distinguishable in a way'^hat coiQpels a different legal result* 

The usual law school course examination ^s designed along the 
same lines and is meant to test the student's development of 
Ihese skills* ^The exam consists of several compLex hypothetical 
fact patterns* For eacH^i the student is required to fully 

' analyze tt^e facts and to recognize the var.ious legal issues that 

tbty raise* He must then set forth the applicable principles of 
' • * 

law/ as derived from the decided caseS/ and apply thei^i to tho&e ' 
* • 

hypothetical facts^^^demonstrating bow those facts are ^^nalogous 

to or distinguishable from the ];eported cases* Tt^e 'student is 

expected to make all of tjf^e various arguments for tire position 

each hypothetical party would take* Finally/ the student is to 

assess the p^suasive weight of those arguments in the light of 

decided caseg and to determine the lilfely resul^r^ The answer is 

evaluated/ inot for tt^e substance of the student's ultimate 

result/ but on the quality of his reasoning and sKill in defining 
/ • * * * 



issues, recognizing factual di3;i„ctions;, and 'apply legal ' 
: principles'. 

in addition to the application of legal principles to nos^e? 
fact Situations, the casebook author and the law professor als^ 
, emphasize the historical development of a ligal principle through 
examination of various courts'" handling of the same^ factual 
question. Here is Case I, and here. is case ii; decided 20 years 
later and dealing with a similar factual situation, case li 
discusses those principles set forth' in ca.; i," Does case ii 
emphasize different aspects of the situation? " Doe^ it suggest 
^ «"btle refinements Of the ifegal principles? Does case ii broaden 
the application of ^hose principles to truly dissimilar facts,'or 
does it restrict those principles w the facts of Case 17 Does 
the latter case. conscibusly or unconsciously reflect changed 
social, political, or economic perceptions? or'does it simply . 
follow the r.ule.of Case „ith or without consideration of such 
factors? ' 

An et,sential element of the-^case method, then, is a constant 
analysis and criticism of the court;s reasoning. The professor's*' 
questions are intend'ed to'stimulate the ^tude'nfs Lepe«dent 
evaluation of the judge's opinion according to established 
^standards. , on the on, hand,' the decisiop. may be criticized on 
purely logical grounds;. the judged analysis may »ake an 
inductive leap Without adequate support, therefore failing^. 
Withstand logical scrutiny.* The opinion is then flawed in its 
persuasive and precedential effect, or it .nay be tha't the ' 
student is asked to Criticize the case on purely* legal ' 
grounds-to assess the particular Judge's- own understanding a^d 
statement of legal principles as expressed- by other courts. 

Alternatively, it «ay be that a decision cin be faulted on' 
policy grounds. - The. court may' have failed to take-account of 
salient social or economic gials. a court may mject its own ' 
View- of thing* into a d.cisipn and ^„force compliance with that 
view, or the decision may backfire in the face of its intended 
effect. For example/ a decision that was intended to protect - 
low-income consumer, by making it »^ difficult for 'seller, .to 



reclaim installment plan goods, may , -simply encourage sellers to 
deny credit to poverty-level consumers altogether. Successful, 
effective case criticism Qf this sort /obviously demands close"^ 
reading on the part of t^e student and considerable depth and 
breaath of social and politacal understanding Qn the ''part ^of ttut 
professor. The challenge to the teacher is to translate his own 
knowledge into quesCiohs that will stimulate a similar 
understanding in, the ^tudent\ ^ 

It is obvious tl)at the use of cases as original material to 
be learned lends itself^lwell to the use of the SotTratic technique 
of pedagogy. Law professors who take the Socratic technique 
seriously will rf£t articulate legal concept^ or principles, but 
would rather require students (o formulate and generalize their 
own principles by questioning them about variouarasp^cts of the 
assigned cases» Obviously; the study of the rav^^naterial o£ law 
does not mandate this type of instruction; it mJiy often be 
appropriate for the teacher to organize and summarize the major 
points injthe development of a particular concept and to 
Articulate a rula, or even a coherent theory/ which describes and 
explains the results in a set of cases. Even so, the emphasis in 
legal educatrion" today is still upon a student*s development o€ 
his or her own understanding of an area of law, not only through 
the study of recorded cafifs, but also through the application of 
the Socratic technique to that material. " 

The successful integration of the Socratic, technique with the 
case method clearly\equires trejtnendc^s s^kill on the part of the 
teacher. Proponents of this techhique emphasize the value of the* 
inherent student participation for his own learning, but it must 
be remembered that this participation, although active, is nearly 
always responsivq in character. It is the professor who 
initiates, who formulates the quest ^bn? and elicits the student *s 
response; the response is necessarily shaped and limited by the. 
question. The professor's task is to translate his owrr 
Xjnderstanding of the points to be made into a series of 
quest ions«=^:^that^ questions which have been organized into some 
logical sequence— *which will ^llow an attentive student to 
« « 
.5 
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recognize those points and to extrapolate thaj: organization* Any 

successful teacher must e££e<^'ively int^g^^ate stude'nt guestions\ 

■ • 

responses^ and , comments into his presentation *o£ material r 'but 
th&t skillful integration 'is especially crucial where the subject 
material is presented almost entirely in'the form of questions. 
The «law professor poses, a questiOT^s the student responds; the 
professor must recognize the 'student's level of under standing^ 
meet itf>and therv.elevate it. The necessity of these universal 
teaching skills^ is magnified by-^he §octatic technique. 

The combination of^ the case methbd and the Socratic technique 
has a dual purpose: first; to instill in the student an accurate 
and coherent set>of l^gal principles; and second, to train the 
novice m the application of those principles to unique factual 
situations. The combination cari be most inefficient, and 

^sometimes wholly ineffective, means' of teaching complex 
principles, it is only too easy for even a diligent law student 
to miss crucial distinctions- or to omit an important concept from 
his mental outline altogether* The reason for these students' ^ 
confusjton is' the lack of synthesis and clear direction in both 
ti>e 'instructional materials and in the pedagogical method. « The 
latter, in particular, is based on the theory (which is more a' 
matter than* faith and of empirical demonstration) that students 
in some sense learn better when they teach themselves* Now, it 
may be true that learning to teach oneself (e.g., learning to 
read a case report critically, to analyze and criticize its 
premises, and to g^ene/alize principles £romJ[ts results) is 
itself 'the lawyer's most valuable skill. Ij: may also be true 
that>the most efficient way to develop that ^kill is by^ actually 
doing it under ^ professor's critical supervision* Hone^ihelesSi 
it^ts not unusual ^or .a /student to mis-learn a concept, and even, 

, through his prodigio^js efforts' to understand and apply that 

concept, to reinforce id^as which ar^^ simply wrong. Where r as"'' 

with law,^there is a relatively large body of accepted, highly 

» • 
complex and subtle principles to be masteredi, the combination of. 

the case method and the Socratic technique is often worse than 
■ ff 

6 
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simply ine;(f^cient in teaching those principles; it^n be 
squacely" counterproductive. ■ - " " 

From t^ese students' point of view, the corollary of this 

inefficiency is frustration* Th^ successful use of the< Socratic 

technique ^depends heavily on adequate' student ^gjeparation for the 

professor's questions, ^6 ^deq^ate prepacatioit i&Ar^mendbusly 

tlme-coniuming* Unfortunately, for ma^iiy studAts there is simply 

n^ver enough time to devot» to careJ^dl ^eadt^^and analysis o^ 

all of the assigned ca&^s* Ther'e no such thing as "^sK^irnmirig** 

^ C2Lse; it fiust be read slowly and -carjefblly, usually several 

times^over,t with h<jtes taken and points record^jS. And this jaust^ 

all be done^by oneself, for, oneself/ in'^order to .construct, 

cqncept by concept and principle by principle, one* 6 own montal 

view of that particular arJa*af^ law* ' ' 

^ Moreover, there is nevet any guarantee for the stuQent^^Jhat 

time diligently spent in the close study of a series of cases ^ 

* will yield a proportionate share of understanding* ,With only 
t^Tnimal guidance from the matetial itself, the student is 
expected to generate a cohesive stru^cture of legal principles* 
As often as not, however, the professor^'s presentfition of that 
same material bui^s d« complete structure, one whi^h the student 
does not recogpize*. Ironi^^ly, the harder a s^dent works to' 
prepare, the more frustrated he iiiay become when his laborious 
built structure does not match the professor *'s^ The student who 

, he^ merely read through the assigned material, not taking time to 
generalize rules, may be betJ^ able to understand the teacher's 
point* The ''problem of having to teach oneself a very large body 
of complex, difficult matei^ial, ,in that it is 'time|consuming *but 
with no guarantee of Aastety/ can be entirely, irritating»and to ' 
such a^gree that it beC(^s a further hindrance to learning. 
Tt'' is ea^y to imagine how^much ^ergy and e^ go £f)to tt^e 

^student's preparation* ImStgine further the frusttation of 
discovering, after so mubh 'effort, €hat this painfully devisQd \ 
mental picjLure' is^out of focus, or perh^s of, the wrong landscape 
altogether* Law students often fe^l thelndelves caught in a 
three-way bindt Ho matter how long and hard they, prepare, they 



oan' never ^lean all the fine ^points fron ^ case; i£ they prepare 

too little/ trying to g.rasp simply the points of the case/ they 

cannot folXow many of the teacher's questions or rouct) of the 

cl^ss discussions; and if they pcepare diligently and develop 

• \ 

their own detailed understanding of a c^ssk/ th^y run the ri^K of- 
learning eri^on^Os^pri too Wb^l, 'The result is more 

frustration. 

'Voo, law studenl^s tend to 'be a horapgen^ous grtfup/ at least in 
the! sense thatvthey have cone excee^ding^ly well in utidergraduate , 
school* -In the roainr they coiQe^to the school confident ip thfeir 
ability to m&stpr a body , of subject materiTal/. to learii the;** 
answers, ' For many of them ^the combination of the ^ase met'^od and 
the Sf^ratic technique is a source .of tension' in ^its insistence ^ 
on the ambiguity and non**f inality of every answer. Leai;ning to 
tolerate this uncertainty i9 perhaps one bt the most difficult 
lessons for ^he[ law student, and it is aggravated and intensified 
by ^t}e pedagogy' employed*'. This is* not to say that^ thijs* is a 
disadvantage of ^he case roethod/Socratlc technique* ^On th^ *^ 
contrary, it may b^ a distinct advantage^ to the «^xtent that this 
;3ort of negative capability is an essential professional 
attribute of the lawyer't^S^It is<to eay that/ whete law students 
are unaccustomed to this aspect ot learning in t^eir* ^ ^ ^ , 
undergraduate education/ it' can be an emotiona^y difficult 
adjtistm«nt* ' , 

The student**5 undergraduate experience may not fully develop 
all th^ learnijng sliA^hfequired under the prevailing legal 
pedagogy* 'stud^WHl^ve^ already * learned/ only too well/ how 
fo leaden fron te&tbopks and ^lectures* They mia} have had some 
dxperienc«^ in independent study/ but even t^h^t^is likely to have 
been structured Jor them* With this sort of Instructional 
badtgroundr it can be a wrenching adjustment to be require^ to 
literally teach oneself compltiX/ detailed concepts with virtually 
np gdi^ance* ' * 

I It stems to me that the law student is called upon to .see 
three distinct learning skills* ' First/ he must comprehend vasfy 
quantities of detailed/ cpmplex subject^ ^matter; undergraduate 



^tudy, may Kave developed this "ability fairly \^11. . Secondly, the 

student is required to develop bis independent organization of 

that material, *antl further, to ahalyze and synthesize this body 

of material 1^ a manner tjbat is unique to' him* Here again, the 

•**student may have had tAe benefit of this experience as an 

und^rgraciuate in tHose courses of study which emphasize the 
4 

process of reasoning more than the final product, in which no 
••right' answer** is recognized* Thirdly, however, « the law student 
IS expected to apply his own mental structure, his own process of 

9 

reasoning, to completely new factual situations and to analyze 
the likely results* It is this application akill which » is likely 
to be new to most law studeMs* and which is central to-^the 
learning task required of them.** People who have alyays , , 

Identified themselves as '*good students'* suddenly find themselves 
expected to use .skills which they may pev^r have had to develop; 
Again, the result is frustration* For adult students with a 
successful education career behind them, this frustration at not 
b^ing* able to learn can itself bexiome an obstacle of major 
pro^rtions« , ^ ' / * 

bn the oth^ band, it'is'certainiy' true that this learning to 
teach oneself is the fundamental skill of a lawyer; and if the 
products of our under^graduate schools do. not have this skill upon 
entering law school, then the law school is obligated to somehow 
develop that skill* If, as noted above, law- schools u^e the case 
method both to teach legal principles and to train students how 
to apply those principles, then the latter goal, at least, is 
fairly well served* ^ ^ 

Irv the day-to-day practice of *law', lawyers must deal with 
"raw" cases; they must decide hov a reported decision bears upon 
the* factual cirspmstances their clients present to them* By 
studying cases themselves, students ate forced to analyze^ Vhe 
sasiie material that lawyers must deal Jf'ith'. They learn ^o analyze 
a case by doing it and by having that analysis criticized; they 
learn t6 apply the easels principles t^ different facts by doin?^ 
-SO and havihg that application corrected/ This is not to say 
that the case ^method could not be considerably refiopd and^^ 



improved jover its v^esen^^ff notice. For example^ that process 
could be ^one more ^effici^ently ^and less painfull^^ with more 
individual instruction ^&t)an is no\f ty{>ical# but that is largely a 
matteiT o& econ^nics and not of pedagogy, fcr learning how to use 
c^ses — and th^t .is an irrdispensible skill for a lawyer — the 

''Socratic^ use ot the case'method is, surel^ adequate and ef^icient^ 
if not actually martdatory, * ' 

In addition^ the socializing aspect of the case method should 

^not be discounted. The law^rofessor*s annoying insistence on 
always asking one n^ore ^^esTlon, adding one more wrinkle, does 
hive a'fcumula^ive etiSit oij the student. After three years of 
facing ponstant dissatisfaction^with ^the easy answer, the student 
do^s become deeply cbnvmced of the lack of finality to any le^al 
^ issue. The mediup b^^rs an important mes^g^, i.e., to keep 
testing an aigument b/^ taking it one A^qre step. Moreover, the 
student comes ^r^believe in a S9rt of legal Relativity, m the 
idea that results do^'^nd ought to differ according to differing 
facta* and policies, even though one encompassing principle *is 
supposed* to govern all of those differing circumstances, in 
addition, typical law school instruction teaches, oi^ten^ 
unconsciously, a healthy disregard\for the^legitimacy of a wholly 
logical approach to human problems* A law achooi cXtfSsa can be an 

0 

- excellent demonsfr^iitifo of the limits of rationality* It is a 
lesson that lawyers should learn early and remember long. 

On a more objective level, it is clear that the use of cases 
is better ^suite^ ^to^ teaching 'Some aspects of law than others* 
Obviously, areas that are seldom or never the subject of 
^ r^tlgation cannot Ke conveyed through case study. Such areas 
include the function and responsibility of the organized bar; 
. ethical^ considerations in dealing with clients and conducting a 
ciuth the e£ficie{it ^organization p£ the courts; the numerous' 
practical problems oi runn£ng a law firm. The proper drafting 
and inte/rpret^ti<^ of legislatioij^^; likewise unsuited to the 
case method* Furtheir^ the study of cases is a wasteful and 
inadequate means of grasping the historical development -of legal 
concepts and of tecogn£%ing and ^assessing the unexpressect impact 

10 ' . K 



of socia}., economic, anc} politicaJL^ factors on judicial 
decision-makmg. The primary, s'hoctcoming of legal education has 
not been tha.t the case method cannot ,do everything well, 'but t'bat 
^too often no alternative has been provided to fill these' 
unavoidable gaps. ' * ^ 

What can be successfully taught in this way, again, are both 
a *body of principles and their application to particular factual 
situations. Further, the use of actual cases does shed some 
light,; hjOwever unevenly, on the attual practices of daily life: 
contmercial and business practices, family situations and customs, 
police policies, g^eneral Culture. This adds an extre degree of . 
intferest to the study of otherwise dry legal principles. And by 
* constant exposure to various factual patterns^ th^ student can 
gam some intuitive grasp of the situations tha^^ give rise to 
legal^ problems. * r- , * 

Final^ly, the metjidU also stimulates independent critical 
thinking, and gradually some confidence in one's own ability to 
de^l with the primary materials of .{j^e legal profession. The 
successful use of the case method can be highly stimulating j 
intellectually. PerlMps It^ is^ best after all to emphasize the 
strengths of the case method in legal education, recognizing its 
shortcomings^ and compensating for thoj^e by supplementation with 
other techniques. ^ ' \ 
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Part III The /Education of Lawyers. 
as a Parallel to ^he Education of Evaluators 



X., What Information Might an Evaluation Case Histogy doptain 

If case histories are to be*u9ed in the education « 
evaluators, th^n it is necessary to look at what evalu/tion case 
histories ai^ht be like 

ilie format of the legal case history is as ^follows: 

Na^ o^^ase 
Case SusEsary 
• Headnotes 

Opinion or the Court 

An evaluation case history might follow a similar format* 
The brief summary provides quicic, r^ady information on what the 
case 'is all about* ^ 

The headnotes ^ora part ot the categorization system. 
Headnotes are sentence^length statements of the ^principles of law 
discuf^sed in the opinion* The headnotes are numbered, and those 
lyjmbers are printed at;appropriate points within the text of the 
(Opinion itself so that the researcher ^can quickl^^find the 
sectipn of the opiniqn cited ^in Vihe "headnote* In an evaluation 
case 'history, value principles correspond to legal principles. 
It is uncertain whether the headnotes described for legal case « 
histories would be appropriate for evaluation case histories* 

K judicial opinion is divitied into flVe ^ts and each will 

be discusftd in turns - . i ^ 

■ * 

1* ^e j>^ocedufar hiitory of tt\6 particular action; 
2« A f tAtement, of the facts ^ the case; 
3* A ftateailint'^of the' legal issuers to be decided by the 



court; 

^ 4« A discussion of 3»egal principles, as set forth in 



^prior 4*<^isibns and now^applied to *the factsyof the 
present case; 

5. The result reached in thfi, case. . 



!• The' Procedural History ' 

A legal opinion will stajie at the outset whether this action 
is before the trial cpurt or^ befojfe 'the court of appeals*^ 
Moreover, it will b'e stat'^ whether one of the parties have asked 
for a decisio^n as to only a^ distinct part of the case at the 
present time* If it ^s an appellate decision Which iS being 
reported, it will be carefully noted, not only wb^ch party won 
before f but also which issues have been preserved ^or review by 
the parties* This suggests that an evaluation case history 
report on prior evaluatioTis (if any) aVd indicate if ^he ^ 
evaluation iAues in the present 'evaluation are the same or 
di^erent from prior Evaluations* The procedural history of a 
court action must be thoroughly set fortb, because <that procedure 
legally limits the issues pifesented to the court for decision at 
this juncture* Correspondingly, the aspects of the evaluation, 
which limit the evaluation issues dealt with by the evaluator, * 
can be set fortfi. Examples of these aspects are as follows: . 

(a) Ttie charge-^negotiations-conttact* The charge gi^ven 
the evaluator by tbe client including any 
restrictions placed ^on the evaluator in the 
negotiations and contractpjif any) will limit the 
issues «dealt with* 

(b) The audiences* who the audiences/^are and\whatj are 
their questions will determ|j)e i-ssues* ^ ^ 

'^(cj The Resources*' Usually the evaluator only has 
. resources to deal with a few 'major issues* 
jiesources Include zz^ney^ time^ and personnel to 
carry out the evaluation* 

2* The Facts of the Case * 

A judicial opinion Includes V presentation of the facts of 
the ca^e* T^^ idbts of a case must -be relevant to tlie legal i 
issues of the case^ Not all c^ses are ;:ried by a jury^ -but in 
those which are# the Jury receivi^tiie evidence^ evaluates it^ - 
and'*£inds the factil'^t-i^e* ^ decides which version of the facts 
presented is the true version* The Judicial opinion^ thtn# will 
set forth the fapts as found by the jury* ^ * 



• * * 

*> 

In a siCQilar way, an ^valuation case history would c6ntain a 
staJiemenV'of the faclts as found by the eyaluator. As with the^ 
law, tne facts must be relevant to the issues of the case. For ^ 
an evalQation, the facts are not decided by a 3ury but are^a 
by-prod«}ct of the methodology* used by the evaluator* If the 
eVfSluatpr has used an experimental^control design, the facts will 
be atx^ut measured^ outcomes. If the ev^luator has used a ^ ^ 
responsive approach, ttTe facts are likely to be about processes^ 
^ transactio;)S antd human judgments. Hence^ besides describing the 
facts,, an evaluation case history should^clescnbe the methodology 
used by the evaluatdr. , , ,^ - 

The lawyer's presentation'of a set of facts is governed by 
the rules of evidence. These rul^s have been developed to allow 
'the tryer of fact to consider^ only evidence that is relevanti 
reliable, and not unduly prejudicial. The^ rules of evidence are 
^so law. They are legal principles developed by the courts for 
their own use. , Questions as Jto the admissibility of a given bit 
of evidence are fi;«quently the subjj^eet of written judicial . 
opinion's. ■ ^ ^ 

In evaluation the rules of evidence or the knowledge^ claims 

are embedded in the methodology. This is another reason why the 

methodology used sV^ould be indicated. Evaluators k^oVe rarely 

considered tne question^of the adnissibility of evidence that may 

be, pre judicial in evaluatfing an entity but i9 no:b relevant to the 

is^es under evaluation^ As with the law, the question of the 
„ * .* ^ 

^adai^sibility of a piece of evidence could be part of an 
V ' ■ ^ * 

ev^uation ca^^ history. , 

3^ The Issues 

' " The legeil isaifes are the focus of a court's decision » Stake 

and Easle^^ (1978) ^explain what he means by an evaluation issue. 

An issue is a circ^Mtance about which people disagree. 
It usually involves 1| vcondition having 4ome features 
causing (ot believed. tOLcaijse) certal)) effects. These ' * * 
affects are va).ued differently by different people~8o 
they'disagree as to whethiir and how the condition should 
. be changed. • w > ^ 

\ ^ ' * * 

\ ■ ^ . 



Th^ Ingredient^ Cor an issue, th^n, are the >.copditions, ^ 
the eCCects, the relationships between condit^ion .and - ^ 
eC£ec,t, the dlCCerent valuing, and the alternati^^es among 
course s**o£-action Cor changing conditions. 

Stake (1'975) explaiils Dow« he identiCies issues and uses 

them* He Also give^ examples oC issuer*' . 

Jnstead oC objectives, or hypotheses as ^'advance' 
vbrganizers** Cor an evaluation' study, I .prefer issues . I 
ilthink the word ** issues** better reClects^a sense oC 
complexity, immed'iacy, and ^^aluing. ACter getting 
. ^apquainted with a prograjii, partly by talking with 
, studentls, parents, taxpayers/ program sponsors, and 
^^program staCC, the evaluator acknowledges certain issues, 
\ problems, or potential problems. These, issues are a 
^ ^tr-ucture Cor continuing discussions with clients, staCC, 
and audiences. Cor the data-fathering, plan. The 
systematic observations to be made, the interviews and 
tests to be given, iC any, should be those that 
contribute to understanding or resolving the issues 
identiCied. 



i 
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J 'In evaluating TCITX, a summer institute Cor high school 
^ students, Craig Gjerde and I became aware oC- such ^ 
issue^uedtions ast ' 

Is the ad^aissions policy satisCactory? 

Are some teachers too permissive? 

Why do so Cew students stay. Cor aCternoon? * 

Is opportunity for trailiing younger -teachers well 
* • used? 

■ 

I? this institute a "lighthouse*"* Cor regular school 
curriculum innovation? , * 

^ What couJ.d correspond to the legal issues would be what Gowin 

(1979, p* <ialls the tellifrg questions oC an evaluationv 

According ko Gowin (1979)- telling ques^ns .are the most I 

signiCicant quf/^tions o^ an* evaluation aftd are few in numbe.r. 

'They mu^t be distinguished from technical questions* -felling 

questTions *'tellyon*' the .context atfstmed or made explicit by the 

evaluation* Telling questions are ndt always' C^und in evaluation 

d^udles; th^^oi)]^ questions' asked ^^ape technical: questions. In 

iiq^e evalu^^^^ns, telling^ questions are asked but not answered^Jby 

the evaluations*' Telling questions may^t necessarily be made 

«aplicit In an evaluation s&udy but may have to be inferred* In 



an dppraisal o£ a, Head Start evaluation, Govin (•1979^^ i,ndicates 

that the 'telling' questions, ate as follows* *\ ^ 

(a) \AVe children who participated in Pro3ect Heaa,St;art 

> better prepared' for kindergarten, than those who did 

: n(it participate? * ' , . 

<b) Can racism in America be combatted through the means 
of schooling? * . * • ^ 

4* The Conceptual Pringiples ^ ; ^ 

Legal principles*, when applied to the facts of a case, result 
in a decision regarding the legal issues* The discussion of^ 
legal principles is central to the case opitiion* ^he discussiSn 
is' intended to be a logical, neutral exposition of legal \ 
f>rinciples, derived from precedent (or fi^om the statutory text) 
and reinterpreted in light of ^ the particular facts fCaced by tt^e 
court. ' * - 

It is not immediately clear what aspect of an evaluation , 

t 

study would correspond to legal principles. The use of legal 
principles involves logic and reasoning, and represents the 
conceptual side (in contrast to the factual side) of a legal 
opinion* Thus a discussion of the conceptual as^iects of an ^ 
evaluation cobld correspond 'to the di^cu^sion o£ legal principles. 

A 'discussion of the conceptual aspect^ of an evaluation could 
involve some of the following suggestionjb by^^owin (1979)*' An' 
analysis of the key concej^frs of the ev^tjUKipn/study could be* ^- 
carried out« • The telling questions themselves usually contalyi 
two or more key concepts* Some concepts , will be more .important 
than others* Some concepts will subsume others* It is possible 
to draw a concept lhap by arra^n^lng the concepts in Bn -^rder with, 
the most powerful ideas at the top of a sheet o( paper and^ the 
<^ubo^dinate ideas towards the nidd3^ of \the page*. The 
*operatior\al conceptSr those clpsest to t^e events of interest in 
the evaluation, will appear toward the attorn of the page* 

^ Under the copceptualization b£ an evaluation vill fall ^ 
assumption$« Usually -an evaluator is forced to make several' 



assumptions* An evaluation case would expMcate the major 
assumptions, o£ an* evaluation* ' , * ' ' ^ 

Th0 patterr^^oC reasoning, the ifiain arguments and the logip of 
.the evaluation study can be /explicated* There will be two types 
o£ claims made by an evaluation stu<)y — knowledge claims and*value 
claims { ffie reasoning that leads to these claims can be * 
discussbd,* 

r 

We believe that there is a Iqgic of justifying value 

judgments or claims. This logic will be briefly discussed since 

^uclx discussion ^arely^ occurs in the evaluation literature. The 

discussic^ is ba^d on, a chapter by Coombs (1971)* 

When an evaluator makQS a value judgment / |the evaluator makes 
« * • I t 

a commitment to: fl) -a value principle , and (2) a's^t of facts' 
about the valu^ object which shows that the principles applies to 
the v^tue object *' The facts *an4 the value principle comprise the 
premise^ of a deductiye argument having the value judgment as its 
conclusion. The Value object ^s the entity being evaluated* 
Making a value judgment commits the evaluator to a value 
principle because the evaluator *8 judgsS^nt logically imp;Lie8 a 
principle. If an evaluator says ^hat a certain reading program 
is good, the evaluator makes a commitment to the value principle ^ 
that apy reading program like this one is good. It would be ^ 
).Qgica],ly inconsistent to asse'rt the judgment and to deny the 
value principle. The precise nature of the value principle 
implied by any Judgment is indicated by the, facts wnich are given", 
to support the judgment. Suppose that an evaluator saya thi% is 
a good r^din^ program because the studei^ts improve on h te^t of 
reading achievement and become more interested in reading.- If 
increased achievement and interest *are what make this a ^ood 
reading program^ 'it follows that i^ny reading prograi; with these 
same features must be regarded a8\good. The value principle 
implied Jn any jud^Qnt relates the supporting tacts ^6 the 
evaluative term used in making the judgment.^ In the example 
^above^ the valuei priricipld relates (acts about achievement and 
Interest to the^ evaluative ttpm "good** ^ . 
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We know \i no evalu.ation report that clearly sets forth the^ 

logic o£ the -evaluative reasoning* The following example taken 

from Coombs (1971) i.s outdated^ t>ut stili'';sn example of ^^'"'''^ 

evaluative reasoning* Suppose an evalua^r }s tryipg. to 'decide i 

whether or not the U*S* "bughtr to withdraw from the war in 

Vietnam* Suppose that the evaluator accepts the following facts 

(f) and criteria (c)* 

< i 
The war in Vietnam is primarily a civil ^war* 

One country ought not enter into the civil wars 
of other countries* 

U*S* , withdrawal will result in a substantially 
* reduced' rate of ^killing* 

It is wrong to kill or to cause a < large number 
6f killings* ^ 

U*S* withdrawal would reduce the devel of civil 
, strife ^n the U*S* 

K stable peaceful society is a good thing* 

ll*S* withdrawal would free U*S* respurces which 
could be used* to cope with pressi^ng social 
prob^Lems in the U.S* ^ • * . 

^It is desirable for a society to have the 
resources available to handlb pressing social 
problems* ^ ' 

U*S^ withdrawal would result in a repressive^ 
communistic society in South Vietnam* ^ 

Illiberal societies are undesirable and imiaoral* 

The U*d. has conmitted itself/to defending South 
Vietnam against takeover by the cocs&un ists* 

K nation caught to honor its commitments. 

U.S. jj^j^drawal would be construed as a* sign of 
weakness and^lack of resolve. 

nation ought not let others think it is weak 
, ^ ^ or li^resolute* 

Suppose that the evaluator comes to the conclusion that the 

U.S. ought ^o withdraw from the Vietnamese war. Suppose that the 

^valuator coiirtfs to this decision on^ the basis *o£ the first four 

fact s^lstecr above, and in sprite of the l^t ihree« The 

evaluator *s judgment implies a complex value principle to the 

effect that a nation (ought not bi involved in a civil war to sav^ 

a country, from a repressive government if that^ involvement 

' 18 
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^ increases^ the leve| of killing in £he war and diverts the 
-^natxon^s attention from picjessing ^s6cial problems* 

^The*£acts used- in arriving at a value 3udgment must be 



relevant* To be relevant to a value judgment/ a fact has to meet 
two conditions: first, it must be a f^ct about tne entity 
evjiluated, and second, it must 6e a fact tq Which the evaluator 
ascribes some value rating.^ This value rating is know as the 
Value criterion *. In the above example, each of the f acts .werfe 
about the u.S* and the ^ war in Vietnam* In addition e^ch fact had 
? ^t^lue criterion associated with it* 

. What isXthe difference^betweerj^a value principle and a value 
criterion? ^l^alue criteria' are brought to and are involved i|n the 



:ved hn the 
^ as 'i^ * 



making, of thi va\($% judgment*. A value principle emerges 

product 6f tm value judgment. It fs only after a value judgment 

has been madeland the reasoning given for it that we know what 

^value principle is impliedju^ the judgment. £actr^alue^ criterion 

provide#^ the basfs lEor evaluating one particular feature of , the 

value object; each feature of the value object is evaluated 

separately^ A Value criterion does not provide the basis for 

'evaluating the j/alue object as a whole. In contrast, the value 

principle implied by the value judgment does apply to th6 value 

object as. a whole.' , 

In the law, Y set of legal principles, applied to.X set of 

facts, leads to Z legal judgment. With evaluative argument, Y 

» 

fi criteria associated with a corresponding set o£ ^ 
X, leads to Z value judgment which implies W value 
prin^ciple^^ The 'previous two sentences indicate the . - 

nee and contrast between legal argument and evaluative 
Evaluative argument is rarel/ explicated in an ^ 
evaluIi(tiory|report, but this could be^donl in^an evaluation case 
history. 




5» The'Decision 

The court renders-its decision! Y set of principles, applied 
to X set bf facts, yields Z result. ^ Corresponding to the 
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decision would be ttre answers, given and claima ma'tfe by an • 
evaluation study.^ Gowin (X979f p» Z) suggests the* following' 
'questions. What answers ver^ given to the telling questions? ? 
Which questions did the evaXuator knpw he or 9he failed to 
answer? ^ Which answers did^'the evaluator ^give to questions he or 
she ifailed to as|^ in the beginning? What cji^ical limitations* 
was the evalif&tor aware of?^ What claims beyond the original 
questions did Jthe^e^luator make? ^ ^ • 

Sutoary of Tnf^raatiop an Ev^iluation Case Might Contain ^ ■ 

The information that ^ght be presented by an evaluation ca^e 

history could bTe partly summarized under the acronymn, ^EMAC 

(GoHin, 1969) » QU£;HAC sfceinds for a series of six questions that 

cjin^be asked of any valuation* ^ These questions! wtlen answered^ 

give a sens^ of the wWle structure of an evaluation, study* This 

structure is^the pattern of ideas or concepts shqwing what has io 

be thought about to make ser)se of an ^varuation4 QUEMAC is a 

form o| meta-evaluatiOn» The six aspects of an evaluation that 

^QUEHAC stands for are as follows. In parentheses ace shown the 

'corresponding aspects of a legal opinion* ^ J 

Q Questions IThe LegaKIssues) 

U Unquestioned Assumptions (Th^ Legal Principles) 

B Event or Object Evaluated (Thl Pacts of a Case) • 

M ^ Method ($he Pacts of a Case) , " / 

A Answers/Clafllis (The Courtis I)ecision) 

C <:oncepts/Coneptual Structure (Thejliegal 
Principles) 

What is tnissing £r<^ this six-point list is references to 
procedural ^history* This needs to be in the information suppliM 

by a case history* The iiiforibation supplied under the above six 

> ^ ■■ 

categoties' plus the procedural history Should not be extensive.^ 
"What should result is a brie£# structured description of an 

evaluation* Th^ writer of the case history should expand on 

amything that is new or unique to an evaluation* Judges # with 
^ the possible aid of their l^w clerks, write up their legal case 

histories* Correspondingly «^valua tors can write up their 



evaluation case histories* However^ (^eMaC i& flexible enpugh 
that. {Persons not assoCiated^Wlth an evaluation can cead the 
evaluation* report and wrate up an evaluation case history^.- 

♦ 

- ^ B. Assent Devices of the Case Method m 

? ~ — ^ : ^ Z ' W 

Whi'le the pase methosjd of instruction has varie'ci considerably 
in different courses, under different teachers^ and in different 
law schools^ t;^ree devices have' generally been deemed essential: 
'(1) the casebook; (2) the participation of studexjts in the class 
discussion; (3) the problem type of examination. Each of the^e 
has its vSriation* * 



1* The CasebooK - * / 

A casebook of evaluation case historias could act as 

(a) an alternative or supplement to practical experience; 

(b) ,, an alternative to reading^valuation reports 

• ^ ♦ - ^ ' 

It is instructive to look at what constitutes evalytion 

training., Geptiart and POtter (1976) carried out a survey of 

institutions of hi^^ti ^education, which offer training in 

evaluation* Eighty-one Of the ^19 institutions surveyed 

responded to the questionnaire^ Af leas£ 5^\erc$nt of the 

institutions which responded regarded courses in evaluation as 

being so].ely concerned with measurement and statistics* These 

institutions not teach evaluation theories or models* The 



sdld noj^^a 

use of a ca^bootf bf case histories by these institutions would 
en the md^ning of eval^tion. At least 46 percent of the 
uti^ns required students to. carry out* some kind o£ ^ 
pr^ct^cal ^training in ey^Quation* * Pcdctical trz/G)ing' is often 
limited to one or two evaluations* Th^ use of a casebook of case 
t\i^^^e4^^ by these institutions would supplemeht the practical 
experience of students, .because it.j#*uld describe a broad range 
of evaluations* Thete is^a physioal impossibility of providing 
for" all tlie .stu(j%r)ts ih the class cea^y and convenient access to 



the original reports in the library The casebook saves wear an(] 
^ear on the' library, and on the student, too* An evaluation case 
history is a summarized form o£ the original evaluation report 
and,, thus, is ibore convenient^ and less time consuming to read* 
The evaluation case history *is written with the evaluators as'^ ^ 
audience, whereas the original ev^aluation report is written for 
the clients. Consequently, the logic and methodology will be * 
laid out more clearly in the evaluation ca^e history since the 
*w£iter will have in mind the evj^^uators as audience. 

If one asksi What cases are included in a legal casebook y 
what excisions are made from the original report) how are they 
arranged; what materials ^ctrlncluded wit^ them? — one finds* 
considerable diversity-in theory and practice* An evaluation 
casebook cpul6 include a broad* range of cases or could include 
cases on the one theme^ such as Title 1 evaluations. The 
casebook 'author could choose the cases he wishes to present and 
organize them in sections, illustrating the various subject 
mattery. The cases could be arranged to show the development of . 

. at particular concept or to contrast different evaluators' 
approaches to the same problem. 

* The cases could^be , edited to sccae degree by^the casebook 

« author f but not sp beaVily edited that oi>ly the crucial 

paragraphs of the opinion are printed* Rather, it would be an 

important part of the. evaluation student's task to learn to 

analyse the case thoroughly and to discover which questions are 

most pressing and which. tirguments are most persuasive* The 

factual context which provides the basis for discussion of the 
* * * 

^alue principles is also ^included in full*y It is the factual 
context which jcolors and gi^es concrete meaning to the stated 
'principles* 



2* The Class Discussion 



• « 



Student; participation in the class discussion is an*essential 
feature of the case methods It Itt a substitute for an orderly 
and pxplioit presenUtion of th^teacher^s ide^s, about the 
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subject meitter* A student is asked to summarize orally a case in 
Cthi8 *l3^ook ; tl#e teachef asks b-im questions about 'it or, put^ to thV 
.students a hyt)Othetical case* tK? student i$ called uf^n to 
defend the student's decision in r^ation to the case in the book 
or hthtr cases* The hypo thetlcalL case, skillfully chosen by the 
biScher, thus becomes one o£ jlfhOv^ief instruments for pulling 
out the^significance tif the main case^^^^ extending or liitrfling 
i^s doctrine or principle* The teachef^ like Socrates, ,asks more 
questions than either the teache/ or the student can answer* 
Socratic questioning could be used. in relation to the logic of 
evaluation case histories* ,The logic of the case involves the ' 
choice of facts and their attendant value Jbr iter ia, vhich leads 
to the value judgment* A value j)rinciple emerges as a product of 
the vaJ^ judgment, glass discussion could focus, on the ^IttxTlce 
of facts and their attendant value criteria as well as on what 
value principle emerges as a product of the value judgment* * 
Another variation in the class disdfts&on is the student's 
statement of the case* The student could be asked to summarize 
the facts, the evaluation issues, the conclusion of the 
evaluator, af^ the reasons which ^ed the evaluation to this 
conclusion* ^ ' ' 

3. The Examination / ^ 

The caie method cours^calls for a hypothetical-case type of 

* J- 

examination. 'The best skill re<{uired ^for the ^ 
hypothetical^ase-essay examination is the ability to analyze the 
facts and to see all the *'points'' or evaluation issues involved* 
The examination could accomplish' this by making the statement of 
facts rather coiylicated, so that a half hour per question is 
allowed for answering* Part of the examination should be of the 
^essay type, in order to test~~the abil^itr to construct a^ reasoned 
argument about a set ots^^facts* ^ ' 
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The legal* case method can be used as a model for the 
education of eyaluators. Howeyerf the fit i^ nonexact, since in 
law one case Li used as a precedent for^h^ argunent that is used, 
in another case. The notiorPcrf^precQdent Is 'not important in 
evaluation. What is concluded in one Qvals>ation case is not 
regarded as precedent foj: what is concluded in^ another ^case. 

The legal '^ase represe^s the solution to a problem. It is 

w 

not a probl^a' ^o, be solved. In contrast^ in business education 
th^e case represents a problem to be solved. In evaluation the 
case could represent the splution to a problemf making a value 
judgment. " . ^ 

It might be difficult to write up an evaluation case history 
if it is^to ir^lude the reasoning of the value judgment. This is 
because (a) tio^alue j^idgment was made in the.ey^ationi or ^b) 

the evaluatpr did not make a cleat statement of the logic which 

* * 'J 

led to the 'value judgment. In contrast^ in the latir the case 

gives the 4bg^c which was used in coming to. a legal decision. 

j/e Jt>arrier to using the legal model in cHe training of 

'^evalu^ors JLb th^atf at p];esenty no sysUm exists by which 

evaluatioT) case histories are written up. Evaluation reports 

could* not ber* used because thjay rarely give an exposition of jbhe 
» " . * 

logic of af^ evaluation* If the legal case method is to be used 
as a model for the training of evalulstors, then several 
^evaluation -case histories ij^eed to be written up. Section A above 
gives an exposition of what an evaltjation case history might be 
like, ^ec^lon^ discusses the essential devices of the case ^ 
methods, and how tHey might be applied to evaluation. The 
conclusion^ is that legal education can be used as a^partial model 
for the education of evaluators. 
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